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1.  INTRODUCTION 

The  Cellular  Neural  Network  (CNN)  paradigm  has  rapidly  evolved  to  cover  a  wide  range  of  applica¬ 
tions  which  are  typically  characterized  by  their  spatial  dynamics[  1  ].  One  particular  area  of  big  inter¬ 
est  is  filtering  for  image  processing.  Enormous  advances  have  been  made  by  many  researchers  in  this 
field[2].  Among  the  relevant  work  is  the  creation  of  templates  capable  of  several  image  processing 
applications  and  the  development  of  special  purpose  algorithms  such  as  halftoning  and  character 
recognition,  to  mention  some[3-6].  However,  except  for  the  fundamental  work  on  color  processing 
developed  by  Roska  et  al.[7],  all  of  the  work  presented  so  far  deals  only  with  black  and  white 
images.  This  probably  stems  from  the  fact  that  the  CNN  paradigm  was  created  only  for  binary  states, 
giving  up,  somehow,  the  wide  range  that  the  activation  energy  is  capable  of.  Yet,  to  handle  realistic 
situations  it  is  necessary  to  advance  the  state  of  the  art  into  color  image  processing. 

Another  interesting  and  propitious  area  of  research  concerns  multi-layer  CNN[8].  Simulation  strat¬ 
egies  based  on  CNN  multi-layer  architectures  are  an  ideal  vehicle  for  color  image  processing.  This  is 
because  each  pixel’s  color  can  be  handled  as  a  triplet  <Red  Green  Blue>  whose  combinations  yield  a 
secondary  color.  It  follows  then  that  it  is  possible  to  allocate  a  layer  of  CNN  cells  to  each  primary 
color  component,  carry  out  the  processing  independently,  and  then  form  the  triplet  to  see  the  results. 
We  call  this  approach  a  sequential  color  processing  mode.  The  counterpart  is  a  concurrent  color  pro¬ 
cessing  mode.  This  mode  results  from  applications  in  which  it  is  not  desired  to  split  a  pixel’s  color 
into  its  three  basic  components.  In  this  case  it  would  be  necessary  to  have  an  output  function  that 
would  be  based  on  the  Euclidean  distance,  or  any  other  norm,  of  the  three  RGB  values. 

The  basic  structure  of  the  simulator  presented  in  this  paper  is  based  on  a  high  performance  software 
capable  of  efficiendy  dealing  with  large  images  in  the  order  of  105  pixels  [9, 10].  The  simulator  oper¬ 
ates  in  a  sequential  mode.  This  provides  an  added  flexibility  to  create  individual  templates  that  can 
be  applied  on  single  colors  to  obtain  a  full  mix  of  applications/colors.  The  simulator  runs  in  an  X- 
Windows  environment  and  uses  the  Graphics  Interface  Format  (GIF)  format  as  standard  input 

Although  CNN  is  already  well  established  in  the  literature,  its  link  to  cellular  automata  has  only  been 
sketched.  Therefore,  as  preliminary  background,  section  2  introduces  the  CNN  paradigm  based  on 
strict  definitions  of  automata  networks.  Sections  3  and  4  address  the  color  processing  capabilities 
and  behavioral  simulation  approach  of  our  software.  Section  5  presents  the  software  environment 
and  post-processing  capabilities  for  image  processing.  Section  6  acquaints  us  with  some  image  pro¬ 
cessing  applications  of  CNN  in  practical  situations  and  also  presents  comparisons  between  different 
color-mapping  strategies  implemented  in  the  simulator. 

2.  BACKGROUND  THEORY 

Cellular  automata  was  originally  introduced  by  Ulam  and  von  Neumann  as  a  particular  case  of  Au¬ 
tomata  Networks[ll].  Cellular  Automata  is  distinguished  mainly  because  its  graph  follows  a  regu¬ 
lar  lattice  Z.  Its  neighborhood  structure  and  the  transition  function  among  vertices  are  translation 
invariant,  i.e.  they  are  the  same  for  all  vertices;  additionally,  the  state  updating  rule  is  synchronous. 
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Let  /  =  Zd,  where  d  is  the  dimension  of  the  lattice.  If  a  set  of  connections  V  C  Zdx  Zdis  translation 
invariant,  meaning  (/.  0  G  V  iff  (j+k,  i+k)  E  V ,  the  graph  G  -  (Zd  V)  is  called  a  cellular  space. 
Cellular  Automata  are  automata  defined  on  the  cellular  space  whose  transition  function  is  also 
translation  invariant:  /,  =  /  for  any  i  E  Zd  with  /  :  Q  ^ Q.  and  Q  the  set  of  states. 

An  important  class  of  Automata  Networks  are  the  McCulloch-Pitts  Automata,  also  called  Neural 
Networks.  Its  graph  G  -  (/,  V)  possesses  a  weighted  structure:  for  every  edge  (/,/)£  V,a  real  num- 
ber  Wij  E  R  is  assigned  to  it  to  represent  its  weight  The  state  set  is  usually  Q=  {-1, 1}  or  Q=  {0, 1}. 
When  the  state  set  £?  is  {-1, 1},  the  local  functions  are  as  follows:/, :  {-1, 1}  ►  {0, 1},  /,  0$ :  j  E 

Vi)  =  sign  ( £  h >j.  Xj  -  b)  where  sign  is  the  threshold  function  (or  the  activation  function,  as  it  is 

yew 

known  in  Neural  Network  literature).  The  weights  are  interpreted  as  synapses  which  are  either  excit¬ 
atory  if  the  weight  w  >  0,  or  inhibitory  if  w  <  0.  Therefore,  the  state  of  the  neuron  at  vertex  i  will  be 

excited  if  the  weighted  sum  ^  w^  x.  is  greater  than  its  threshold  h,.  A  bias  can  be  included  by 

jevt 

adding  a  component  xo  =  1  to  the  vector  x,  and  it  is  treated  exactly  like  any  other  weight  The  well 
known  bipolar  sigmoid  function  with  range  from  -1  to  +1  is  often  used  as  the  activation  function  for 
networks  in  which  the  desired  outputs  values  either  are  -1  or +1  or  are  in  the  interval  between  -1  and 
+1.  Furthermore,  Neural  Networks  are  often  classified  as  single-layer  or  multi-layer,  and  the  num¬ 
ber  of  layers  in  the  network  can  be  defined  to  be  the  number  of  layers  of  weighted  interconnection 
links  between  the  neurons.  In  summary,  a  Neural  Network  is  characterized  by  its  architecture,  i.e.  its 
pattern  of  connections  between  the  neurons,  its  training  algorithm,  i.e.  its  method  of  determining  the 
weights  on  the  connections,  and  its  activation  function. 

CNN  possesses  some  of  the  key  features  of  both  Cellular  Automata  and  Neural  Networks.  Like  Cel¬ 
lular  Automata,  it  has  a  structure  of  cellular  space,  Zd,  with  the  neighborhood  and  the  transition  func¬ 
tion  being  translation  invariant  The  neighborhood  is  shown  in  Fig.  la.  Notice  the  full  interconnec¬ 
tion  between  a  cell  and  its  neighboring  cells.  The  transition  function,  f,  in  this  case  is  a  nonlinear 
differential  equation.  Both  CNN  and  Cellular  Automata  have  parallel  signal  processing  capability, 
and  their  dynamics  is  based  on  the  nearest  neighbor  interactions.  There  are  also  differences  between 
the  two,  the  main  one  being  that  while  CNN  is  a  continuous  time  dynamical  system.  Cellular  Autom¬ 
ata  is  a  discrete  time  system.  Like  Neural  Networks,  CNN’s  continuous  time  feature  allows  real-time 
signal  processing.  Among  the  similarities  are  the  concepts  of  weighted  interconnections,  w,j,  the 
bias,  b,  and  the  activation  function.  The  multi-layer  feature  is  also  used  in  CNN. 

2.1.  CELLULAR  NEURAL  NETWORKS 

The  basic  unit  of  CNN  is  called  a  cell  [12, 13].  Any  cell,  C(iJ),  is  connected  only  to  its  neighbor  cells, 
i.e.  adjacent  cells  interact  directly  with  each  other.  This  neighborhood  is  denoted  as  N(iJ).  Cells  not 
in  the  immediate  neighborhood  have  indirect  effect  because  of  the  propagation  effects  of  the  dynam¬ 
ics  of  the  network.  Each  cell  has  a  state  x,  input  u,  and  output  y.  The  state  of  each  cell  is  bounded  for 
all  time  t>0  and,  after  the  transient  has  settled  down,  a  cellular  neural  network  always  approaches 
one  of  its  stable  equilibrium  points.  This  last  fact  is  relevant  because  it  implies  that  the  system  will 
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not  oscillate.  The  dynamics  of  a  CNN  has  both  output  feedback  (A)  and  input  control  (B)  mecha¬ 
nisms.  The  equivalent  block  diagram  of  a  continuos-dme  cell  is  shown  in  Fig.  lb.  The  first  order 
nonlinear  differential  equation  defining  the  dynamics  of  a  cellular  neural  network  cell  can  be  written 
as  follows 

C~~dir  ~  ~  +  X  A(i,j\k,t)  y^t)  +  ^  uu  +  /  (D 

+  li  -  Lr//)  -  li)  (2) 

where  Xij  is  the  state  of  cell  C(ij),  xij(O)  is  the  initial  condition  of  the  cell,  C  and  R  conform  the  in¬ 
tegration  time  constant  of  the  system,  and/is  an  independent  bias  constant  A(ij;k,l)yu  and  B(ij;k,l) 
uu  are  programming  templates  for  all  cells  C(k,l)  in  the  neighborhood  N(ij)  of  cell  C(iJ),  and  yij 
represents  the  output  equation,  i.e.  the  activation  function  for  the  cell.  This  function  is  shown  in  Fig. 
2. 

Notice  from  the  summation  operators  that  each  cell  is  affected  by  its  neighbor  cells.  A(  )  acts  on  the 
output  of  neighboring  cells  and  is  referred  to  as  the  feedback  operator.  B()  in  turn  affects  the  input 
control  and  is  referred  to  as  the  control  operator.  Specific  entry  values  of  matrices  A(  )  and  B(  )  are 
application  dependent  and  space  invariant  The  matrices  are  also  known  as  cloning  templates[\Ay 
1 5].  A  constant  bias  I  and  the  cloning  templates  determine  the  transient  behavior  of  die  cellular  non¬ 
linear  network. 

In  image  processing  applications  the  concept  of  locality  is  important  Usually,  a  pixel’s  value  is  cal¬ 
culated  based  only  on  its  neighbor  pixels.  Neural  Networks  like  Hopfield  lack  this  property  of  local¬ 
ity  making  them  unsuitable  for  image  processing  applications. 

3.  COLOR  PROCESSING 

To  perform  any  kind  of  color  image  processing,  a  color  model  must  be  selected.  With  CNN,  there  is 
no  exception.  The  purpose  of  a  color  model  is  to  facilitate  the  specification  of  colors  in  some  stan¬ 
dard  manner.  Basically,  a  color  model  is  a  specification  of  a  3-dimensional  coordinate  system  and  a 
subspace  within  that  system  where  each  color  is  represented  by  a  point[16, 17]. 

In  most  cases,  a  pixel’s  value  is  indexed  into  a  table  of  colors  referred  to  as  palette.  However,  bitmaps 
that  represent  a  large  number  of  colors  simultaneously  generally  do  not  employ  the  palette  scheme 
because  it  is  too  costly  in  terms  of  memory.  Virtually,  all  computer  display  hardware  employs  the 
RGB  (Red  Green  Blue)  model.  In  this  scheme  a  color  is  represented  by  the  relative  amounts  of  color 
(intensities)  of  three  primary  colors  that  are  required  to  produce  the  given  color.  The  RGB  model  is 
an  additive  primary  system  that  describes  a  color  in  terms  of  the  percentage  of  red,  green,  and  blue  in 
the  color.  These  three  colors  are  called  additive  primaries.  Mixing  them  is  like  combining  colored 
lights:  combining  100%  red,  100%  green,  and  100%  blue  creates  white,  i.e.  <255, 255, 255>  in  RGB 
values.  Conversely,  combining  0%  red,  0%  green,  and  0%  blue  creates  black,  <0, 0, 0>  in  RGB 
values. 
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The  model  chosen  for  color  image  processing  with  CNN  is  the  RGB  model.  Using  the  RGB  model 
has  the  advantage  that  each  primary  color  can  be  represented  by  a  CNN  layer,  e.g.  red,  green  and  blue 
layers  JE,r,  Lj,  JLb-  Thus,  a  simulation  approach  is  to  have  the  triplet  <RGB>  processed  by  a  three- 
layer  CNN,  with  each  layer  processing  a  primary  color.  Following  this  idea  it  is  then  possible  to 
apply  distinct  templates  to  each  color  layer  and  even  to  apply  templates  in  between  color  layers. 
Therefore,  with  the  ability  to  process  RGB  separately,  plus  the  interlayer  template  effects,  more  com¬ 
plex  image  processing  applications  can  be  done.  It  is  thus  possible  to  do,  say,  edge  detection  in  L r, 
and  averaging  in  Lq,  simultaneously. 

To  be  able  to  work  with  multiple  layers,  the  basic  CNN  equation  (1)  can  rapidly  be  expanded  to  a 
matricidal  equation  of  the  following  form 

-4^-  =  -  xp)  +  V  A{i,j\  k,  l)  yp)  +  Y  B(i,j,k,l)  uu  +  /  (3a) 


yip)  =  2 (!*,/*)  +  ii  -  bp)  -  it) 


(3b) 


where  for  simplicity  the  time  integration  constant  has  been  assumed  to  be  unity.  In  this  last  equation, 
instead  of  only  one  state  variable  per  cell  there  are  three  state  variables  to  be  able  to  process  color.  A 
and  B.  are  block  triangular  matrices  and  I,  x,  y  are  vectors  as  follows: 


‘A,  0  O' 

Br  0  0* 

Arg  Ag  0 

B  = 

Bgb  Bg  0 

A*  Agb  Ab 

Brb  Bgb  Bb 

\Xrij 

yrij 

X  = 

X*ij 

xbij 

y  = 

yg*j 

ybij 

'V 

Ifij 

U  = 

Ugij 

/  = 

tgij 

ubij 

hij 

(4b) 


where  subindexes  r,g,b  have  been  used  to  refer  to  color  layers  £r,  Iq,  JLr,  respectively.  Notice  that 
although  the  state  variables  are  independent  of  each  other,  layer  interaction  is  permitted  through  the 
A  and  B  templates,  see  Fig.  3.  For  instance,  template  A^  has  effect  on  both  red  and  green  layers  si¬ 
multaneously. 

The  characteristics  generally  used  to  distinguish  one  color  from  another  are  brightness,  hue  and  satu¬ 
ration.  Brightness  embodies  the  chromatic  notion  of  intensity.  Hue  is  an  attribute  associated  with  the 
dominant  wavelength  in  a  mixture  of  light  waves.  Thus,  hue  represents  a  dominant  color  as  per¬ 
ceived  by  the  observer;  when  an  object  is  called  red,  orange  or  yellow  one  is  specifying  its  hue.  Satu¬ 
ration  refers  to  the  relative  purity  or  the  amount  of  white  light  mixed  with  a  hue.  The  pure  spectrum 
of  colors  is  fully  saturated.  Colors  such  as  pink  (red  and  white)  are  less  saturated,  with  the  degree  of 
saturation  being  inversely  proportionals  to  the  amount  of  white  light  added. 
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Recall  now  from  equation  (2)  that  the  CNN’s  output  function  is  binary  In  other  words,  if  the  color  is 
taken  directly  from  the  output  function  the  color  would  be  either  fully  saturated  or  black.  Moreover, 
combining  the  three  saturated  colors  <RGB>  would  yield  only  a  small  gamut  of  distinct  colors.  To  be 
able  to  make  use  of  a  full  range  of  hues,  the  color  information  is  taken  from  the  cell’s  state  rather  than 
from  the  output  itself.  Notice  however  that  the  cell’s  state,  x,  is  not  bounded,  and  while  with  fully 
saturated  colors  there  is  a  straight  mapping  from  CNN  output  values  to  color  intensities,  e.g.  6  : 
{-1,1 }  (0,  255},  the  problem  here  is  more  complex  as  the  state  x  can  take  any  value.  In  other 

words,  we  need  to  find  a  function  capable  of  mapping  all  real  numbers  to  the  closed  interval  [0..255], 
e.g.  C  :  R  (0,1,2...  255}. 

We  investigated  two  color  mapping  schemes:  a  continuos  mode  and  a  quantized  mode.  The  latter  one 
is  based  on  a  linear  mapping  using  the  maximum  and  minimum  layer  colors  as  bounds  to  generate  a 
discrete  (quantized)  range  of  colors.  The  general  mapping  is  as  follows 

< = <c  -  '>[£^1]  (5) 

where  z  is  the  quantized  color  x  is  the  current  cell’s  state,  x q  is  the  minimum  layer  state  value,  is  the 
maximum  layer  state  value  and  G  the  absolute  quantized  value  obtained  as  28 ,  for  0<  <g<8,  with 
g  the  number  of  bit  levels.  Recall  from  equation  (2)  that  valid  state  values  exclude  the  open  interval 
range  (-1,1).  This  precludes  the  applicability  of  the  general  mapping  as  we  have  essentially  negative 
state  values  which  could  yield  negative  pixel  values.  Therefore,  the  state  is  mapped  to  a  linear  func¬ 
tion  in  the  following  form: 


z  =  5  +  5,“4g-,)[£^])  forx>l 

z-5-^.o4G -»[£H]}  forx<-‘ 


(6a) 

(6b) 


where  J  is  the  absolute  maximum  color  value,  i.e.  J  =  255.  Notice  that  this  value  is  split  at  half  the 
color  range.  This  is  an  arbitrary  cut-off  which  has  given  us  good  visual  perceptive  results.  Fig.  4 
shows  the  benchmark  used  to  test  the  mapping  technique.  The  template  used  for  this  example  corre¬ 
sponds  to  a  non-filtering  application  characterized  by  minimum  feedback  and  high  gain  feed  for¬ 
ward  as  follows 


0  0  o' 

'0  0  O' 

0  0  0 

B  = 

0  200  0 

0  0  0 

0  0  0 

(7) 


This  template  is  applied  to  all  three  layers  JE,r,  Lq,  and  <&b.  A  high  entry  value  in  the  B  template  ensur¬ 
es  that  the  strength  of  the  input  pixel  value  remains  unchanged.  This  is  further  balanced  with  I  bias 
whose  negative  value  brightens  every  single  pixel  in  the  whole  image.  We  found  no  color  difference 
between  the  benchmark  and  processed  result 
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For  the  continuos  mode  mapping,  the  bilinear  transformation  employed  in  analog  to  digital  filter 
transformations  was  applied.  This  transformation  can  be  characterized  by  the  function  C  :  R  — » 
{-1,1}.  In  other  words,  the  set  of  real  numbers  is  mapped  to  numbers  bounded  between  -1  and  1.  A 
second  mapping  can  then  be  applied  to  the  bounded  numbers  so  that  their  values  can  be  scaled  to  the 
appropriate  color  range  values  between  0  and  255.  The  general  form  of  the  bilinear  transformation  is 
given  by 

*  =  <8> 

where  /is  the  maximum  absolute  color  value  and  x  is  the  state  value.  Notice  that  this  particular  func¬ 
tion  will  map  all  states  x  <  -1  to  Izl  <  1.  This  obviously  leaves  positive  states  unbounded.  To  over¬ 
come  this  problem  the  mapping  is  split  in  two  transformations  as  follows 


-Him]) 

for  x>  1 

(9a) 

-H  [ml! 

for  x  <  —1 

(9b) 

where  x  is  taken  as  the  negative  of  the  current  state  value.  The  mapping  was  also  tested  on  the  bench¬ 
mark  of  Fig.  4.  This  technique  presented  a  small  error  of  2.3%  on  each  primary  color.  This  difference 
is  actually  not  perceived  by  simple  visual  inspection. 

We  can  conclude  that  both  color  mapping  techniques  are  good.  From  our  own  experience  we  have 
noticed  that  for  applications  in  which  sharp  color  changes  need  to  be  highlighted  the  quantized  mode 
projects  good  visualization  results.  In  applications  for  which  the  color  change  is  smooth  the  conti¬ 
nuos  mode  is  very  suitable.  Examples  of  applications  with  sharp  color  changes  are  edge  detection 
and  thresholding,  and  applications  with  smooth  color  changes  are  averaging  and  noise  removal,  to 
just  mention  a  few. 

4.  IMAGE  BASED  BEHAVIORAL  SIMULATION 

Recall  that  equation  (1)  is  space  invariant,  which  means  lhatA(iJ;k,l)  =  A(i-k,j-l)  and  B(iJ;k,l)  = 
B(i-kJ-l)  for  all  ij,k,l.  Therefore,  the  solution  of  the  system  of  difference  equations  can  be  seen  as  a 
convolution  process  between  the  image  and  the  CNN  processors.  The  basic  approach  is  to  imagine  a 
square  subimage  area  centered  at  (x,y),  with  the  subimage  being  the  same  size  of  the  templates  in¬ 
volved  in  the  simulation.  The  center  of  this  subimage  is  then  moved  from  pixel  to  pixel  starting,  say, 
at  the  top  left  comer  and  applying  the  A  and  B  templates  at  each  location  (x,y)  to  solve  the  differential 
equation.  This  procedure  is  repeated  for  each  time  step,  for  all  the  pixels.  An  instance  of  this  image 
scanning-processing  is  referred  to  as  an  “iteration”.  The  processing  stops  when  it  is  found  that  the 
states  of  all  CNN  processors  have  converged  to  steady-  state  values,  and  the  outputs  of  its  neighbor 
cells  are  saturated,  e.g.  they  have  a±l  value.  This  whole  simulating  approach  is  referred  to  as  raster 
simulation.  The  raster  approach  implies  that  each  pixel  is  mapped  onto  a  CNN  processor.  That  is,  we 


7 


have  an  image  processing  function  in  the  spatial  domain  that  can  be  expressed  as  g(x,y)  -  T(f(x,y)) 
wh trtfi  )  is  the  input  image,  g()  the  processed  image,  and  7 is  an  operator  onff  )  defined  over  the 
neighborhood  of  (x,y).  For  CNN  this  means  that  an  output  image  pixel  is  only  influenced  by  input 
image  pixels  within  some  extent  area  r  in  the  neighborhood  of  the  corresponding  output  image  pixel. 
In  common  image  processing  applications  T(  )  is  usually  carried  out  as  a  convolution  process  be¬ 
tween  a  response  function  array  and  the  input  image.  For  CNN  this  is  a  2-D  convolutional  layer  with 
feedback.  The  layer  extracts  information  from  two  maps,  i.e.  the  input  and  the  current  output  states, 
using  templates  A  and  B  to  produce  new  output  states.  For  image  processing  applications  it  is  conve¬ 
nient  to  restrict  the  input  and  output  arrays  to  be  of  the  same  dimension.  Notice  that  when  the  tem¬ 
plates  are  located  on  the  border  of  the  input  image,  the  convolution  process  of  A  and  B  does  not  in¬ 
volve  all  of  its  elements.  To  deal  with  this  border  effect  a  center  zero  padded  superposition  model  is 
used.  That  is  to  say,  a  virtual  set  of  border  cells,  initialized  to  zero  state  values,  is  created.  The  multi¬ 
layer  CNN  raster  simulation  algorithm  is  presented  in  Fig.  5. 

For  the  purpose  of  solving  the  initial-value  problem,  well  established  single-step  methods  of  nu¬ 
merical  integration  techniques  are  used[18].  Three  of  the  most  widely  used  single-step  algorithms 
are  applied  in  the  CNN  behavioral  simulator  described  here.  They  are  the  Euler’s  algorithm,  the  Im¬ 
proved  Euler  Predictor-Corrector  algorithm  and  the  Fourth-Order  (quartic)  Runge-Kutta  algo¬ 
rithm.  Euler’s  method  is  the  simplest  of  all  algorithms  for  solving  ODEs.  It  is  an  explicit  formula 
which  uses  the  Taylor-series  expansion  to  calculate  the  approximation.  The  Improved  Euler  Predic¬ 
tor-Corrector  method  uses  both  explicit  (predictor)  and  implicit  (corrector)  formulae.  The  integral 
is  calculated  by  multiplying  a  step  size  x  with  the  averaged  sum  of  both  the  derivative  of  the  discre¬ 
tized  state,  x(nx),  and  the  derivative  of  the  predicted  state,  xp((n+l)x),  at  the  next  time  step.  The  4th 
order  Runge-Kutta  method  is  the  most  costly  among  the  three  methods  in  terms  of  computation 
time,  as  it  requires  four  derivative  evaluations  per  time  step.  However,  its  high  cost  is  compensated 
by  its  accuracy  in  transient  behavior  analysis. 

Since  speed  is  one  of  the  main  concerns  in  the  simulation,  finding  the  maximum  step  size  that  still 
yields  convergence  for  a  template  can  be  helpful  in  speeding  up  the  system.  The  speed-up  can  be 
achieved  by  selecting  an  appropriate  step  size  x  for  that  particular  template,  See  Fig.  6a.  The  impor¬ 
tance  of  selecting  an  appropriate  x  can  be  easily  visualized  in  Fig.  6b.  If  the  step  size  chosen  is  too 
small,  the  simulation  might  take  many  iterations,  hence  longer  time  to  achieve  convergence.  On  the 
other  hand,  if  the  step  size  taken  is  too  large,  the  simulation  might  not  converge  at  all  or  it  would 
converge  to  erroneous  steady  state  values;  the  latter  remark  can  be  observed  for  the  Euler  integration 
method  in  the  plots  of  Fig.  6b.  The  past  results  were  obtained  by  simulating  a  small  image  of  size 
16x16  (256  pixels)  using  an  Edge  Detection  template  on  a  diamond  figure  on  only  one  layer.  In  Fig. 
7,  simulation  time  computations  using  an  averaging  template  for  images  of  sizes  to  about  250,000 
pixels  are  shown. 
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5.  A  CNN  POST-PROCESSOR 

The  simulator  was  built  using  many  of  the  features  of  the  public  domain  software  XPaint[19].  The 
environment  is  menu  driven  and  allows  to  create  color  palletes.  new  canvas,  in  addition  to  the  stan¬ 
dard  graphics  features  such  as  brushes,  lines,  circles,  etc. 

The  intrinsic  features  of  CNN  were  grouped  under  one  single  menu.  Among  the  features  of  the  CNN 
software  are  capabilities  for  single  layer,  multi-layer  and  time  multiplexing  simulations,  control  of 
the  numerical  integration,  control  over  the  initial  conditions  of  the  process  and  the  color  mode  in 
which  the  system  operates.  Templates  can  also  be  edited  on-line  making  out  of  this  a  very  useful 
feature  especially  during  the  development  of  new  applications. 

Doing  image  processing  with  CNN  may  not  always  yield  the  desired  results  and  post-processing 
becomes  then  necessary.  The  CNN  post-processor  consists  of  a  compiler  capable  of  handling  logical 
pixelwise  operations  among  distinct  color  layers.  This  compiler  follows  the  trends  of  having  CNN  as 
an  analogic  microprocessor[20].  The  added  capability  allows  to  create  new  processed  images  with 
say,  one  layer  processed  by  CNN  and  the  remaining  layers  logically  manipulated  between  CNN  re¬ 
sults  and  the  original  image.  Detailed  examples  of  this  extended  processing  capability  are  given  in 
the  next  section.  Fig.  8  shows  the  syntax  of  the  post-processing  language  using  a  Backus  Naur  Form 
notation;  keywords  and  variables  are  identified  as  boldface  and  italic  words,  respectively. 

All  the  files  to  be  processed  by  this  CNN  pot-processor  must  be  specified  at  the  beginning  of  the 
program  as  indicated  in  statement  1 .  When  a  file  is  read,  the  program  splits  the  pixel  information  into 
its  basic  RGB  components.  This  strategy  is  used  to  create  three  unique  layers  that  contain  the  color 
coded  information  of  the  image.  Statement  3  shows  the  logical  pixelwise  operations  among  layers. 
These  operations  include  the  conventional  NOT,  OR,  AND,  XOR,  shift-left,  and  shift-right  func¬ 
tions  indicated  in  statement  6.  Operations  can  be  performed  on  the  layers  of  a  file  or  a  variable  but 
must  always  be  stored  in  a  variable.  The  only  three  valid  layers  are  assigned  to  the  triplet  <RGB> 
and  are  specified  by  means  of  keywords,  see  statement  8.  Every  variable’s  layer  is  initialized  to 
“black'’  when  first  used.  Finally,  the  new  processed  image  is  spooled  out  in  statement  9  in  which  it  is 
required  to  specify  the  name  of  the  output  file  and  the  variable  containing  the  image  to  be  printed. 


6.  COLOR  IMAGE  PROCESSING  USING  CNN 

This  section  of  the  paper  will  try  to  demonstrate  the  capabilities  of  our  software  and  the  enormous 
potential  that  CNN  has  on  a  wide  variety  of  applications.  For  this  purpose,  we  will  present  five  exam¬ 
ples  with  applications  in  medical  image  processing,  weather  forecast,  image  restoration  and  simple 
color  manipulation. 

The  first  example  deals  with  color  contrasting.  Let  us  bring  your  attention  to  the  top  region  of  Fig.  9a 
( 1 60,590  pixels)  at  the  height  of  the  austronaut’s  helmet  Here,  it  is  very  difficult  to  perceive  a  set  of 
clouds  hidden  in  the  blue  background.  This  image  was  processed  with  the  following  templates[21] 
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'  0.01 

-  0.075 

0.01  * 

-0.04  -0.13 

-  0.04' 

A  = 

-  0.075 

1.28 

-  0.075 

B  = 

-  0.12  0.71 

-  0.13 

0.01 

-  0.075 

0.01 

-  0.04  -  0.13 

-  0.04 

/  =  -0.365 


(10) 


The  purpose  of  this  template  combination  is  to  do  a  soft  edge  detection  on  all  three  color  layers.  The 
simulator  was  set  to  operate  in  a  quantized  color  mode  and  was  stopped  after  3  iterations.  The  result¬ 
ing  procesi  i  image  with  the  clouds  uncovered  is  shown  in  Fig.  9b.  Fig.  9c  shows  the  same  image 
after  the  edge  detection  process  was  completed  in  21  iterations.  Edging  and  contrasting  operations 
performed  by  CNN  are  quite  obvious.  This  particular  example  raises  the  following  interesting  re¬ 
mark.  Notice  that  although  CNN  is  searching  for  the  steady  state  solution  of  a  partial  differential 
equation,  in  image  processing  applications  intermediate  or  partial  solutions  may  be  sufficient  to 
visualize  the  results. 


The  second  example  deals  with  the  X-rays  image  of  a  chest  cage  ( 1 48,370  pixels)  displayed  in  Fig. 
10a.  The  objective  is  to  color-code  the  black  and  white  image  and  to  highlight  hidden  features  in  the 
estemun.  The  image  was  treated  two  times  with  distinct  templates.  First,  a  “pixel  peeler'’  template 
was  used  to  widen  visual  and  hidden  contours  in  the  imaje.  The  resulting  image  is  displayed  in  Fig. 
1  Ob.  Observe  the  black  dots  along  the  contour  of  the  ribs.  This  template  was  chosen  instead  of  a  com¬ 
mon  edge  detector  because  the  latter  leaves  only  the  contours  and  darkens  the  body  of  the  image. 
This  would  actually  alter  the  information  contained  in  the  image  as  our  goal  was  to  only  highlight  the 
edges.  The  template  “peels”  the  rightmost  pixel  from  any  two  or  more  adjacent  pixels;  this  action  is 
executed  through  the  B  template.  Both  templates  are  as  follows 


'0  0  O' 

'0  0  O' 

0  2  0 

B  = 

3  3  0 

0  0  0 
J 

0  0  0 

(11a) 


The  resulting  image  was  further  processed  by  a  “filler  template”.  The  template  was  applied  only  to 
the  red  layer;  the  other  two  remaining  layers  were  processed  with  the  unity  template  described  by 
equation  (7).  These  templates  are  as  follows 


'0  1  O' 

'0  0  O' 

1  2  1 

B  = 

0  4  0 

0  1  0 

0  C  0 

(lib) 


Basically,  the  function  of  the  A  template  is  to  feed  the  pixel  values  of  the  neighboring  pixels  into  the 
current  pixel.  A  negative  bias  is  used  to  avoid  having  an  excessively  dark  image.  The  result  of  this 
operation  is  shown  in  Fig.  10c.  The  CNN  processor  undoubtedly  did  its  work.  Unfortunately,  the 
visualization  of  the  results  is  not  optimal  as  the  image  has  still  many  gray  tones.  Hence,  the  image 
was  post-processed  to  achieve  an  optimal  color  manipulation.  The  post-processing  program  is  listed 
below 

(main  original.gif  edge.gif  edge2.gif 
(xx->red,  edge.gif->red  ||  edge2 .gif->red) 
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(xx->green,  original .gif->green  ||  edge.gif->green) 
(xx->blue,  original .gif->blue) 

(output  (out, xx))  ) 


Thefilesoriginal.gif,  edge.gif,  and  edge2.gif  correspond  to  the  original  black  and 
white  image,  the  image  processed  in  the  continuos  color  mode,  and  the  image  processed  in  the  quan¬ 
tized  mode,  respectively.  The  program  does  the  following,  i)  The  red  layer  of  both  edge  detection 
operations  is  ORed  to  obtain  soft  and  hard  tone  contours,  ii)  the  green  layer  of  the  original  image  is 
ORed  with  the  green  layer  of  the  edge  detection  obtained  using  the  quantized  color  mode,  and  iii)  the 
blue  layer  is  left  intact  The  result  of  this  post  processing  is  shown  in  Fig.  lOd.  It  is  quite  obvious  that 
CNN  was  able  to  detect  the  hidden  features  in  the  estemun  which  otherwise  are  impossible  to  per¬ 
ceive  from  the  original  black  and  white  image. 

Our  next  example  concerns  image  restoration.  Fig.  11a  displays  the  famous  Monalisa  (196,3 1 2  pix¬ 
els)  with  a  white  scratch  along  the  eyes.  The  restored  image  is  displayed  in  Fig.  1  lb.  This  particular 
image  is  very  difficult  to  restore  because  the  background  in  the  neighborhood  of  the  scratch  is  not 
made  of  a  solid  color.  The  background  presents  a  very  irregular  and  granular  surface  which  cannot  be 
restored  using  only  and  Average  Template.  The  use  of  such  a  template  would  tend  to  smooth  out  the 
granular  structures  leading  to  an  incorrect  restoration.  Instead,  a  sequence  of  vertical  and  horizontal 
pixel  peeling  templates  in  addition  to  the  standard  averaging  template  were  used. 

This  forthcoming  example  demonstrates  CNN’s  ability  to  color-code  a  black  and  white  image.  The 
image  presented  in  Fig.  12a  corresponds  to  an  actual  satellite  weather  map  (200,984  pixels)  taken  on 
May  25  1994  (the  reader  can  see  that  we  had  a  very  cloudy  weather).  The  goal  was  to  obtain  a  result 
as  close  as  possible  to  the  standard  color-coded  maps  used  in  weather  forecasts.  These  maps  use 
bright  tones  of  green  to  show  light  clouds  up  to  red  tones  to  show  strong  rain  intensities.  The  image 
was  treated  with  color  thresholding  techniques  using  intensively  the  bias  factor  I.  The  result  of  this 
operation  is  displayed  in  Fig.  12b.  The  templates  arc  as  follows 


0  0  O' 

'0  0  O' 

’0  0  0‘ 

0  2.9  0 

0  20.2  0 

Abbu  ~ 

0  0.1  0 

0  0  0 

0  0  0 

0  0  0 

B 


‘0  0  0' 
0  1  0 
0  0  0 


Ired  —  —0.25  1  green  ~~  —5.9  Iblue  —  —0.55 


The  A  template  is  used  basically  to  operate  on  the  quality  of  the  colors.  A  large  value  in  the  center  of 
this  template  helps  to  obtain  a  brighter  color  on  the  result  This  explains  the  very  high  value  for  the 
green  layer.  A  large  value  in  the  center  of  the  B  template  is  used  to  reinforce  the  effect  of  the  input 
image  on  the  final  result  The  thresholding  function  of  I  bias  works  as  follows.  Negative  values, 
force  the  color  of  the  layer  to  dominate  on  the  final  image.  In  other  words,  if  we  make  I  bias  very 
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negative,  a  weaker  degree  of  gray  will  be  enough  to  make  the  corresponding  color  appear  on  the 
resulting  image.  This  explains  the  different  values  adopted  for  /.  The  result  was  further  processed  by 
the  following  program 

(main  map. gif 

(w->red,  map.gif->blue  | j  map.gif->red) 

(w->green,  map.gif->green  A  map.gif->blue) 

(output  (out,w))) 

This  program  changes  the  white  color  into  red,  allowing  us  to  obtain  the  result  that  we  were  looking 
for,  see  Fig.  12c. 

Thelast  example  is  again  in  die  area  of  medical  image  processing.  In  this  case  CNN  is  used  to  high¬ 
light  the  extraction  of  blood  vessels  in  a  cross  section  from  a  cardiac  image  (68,040  pixels),  see  Fig. 

1 3a.  The  procedure  consisted  in  applying  a  strong  edge  detection  template  with  the  simulator  work¬ 
ing  in  the  quantized  color  mode.  The  templates  used  in  this  operations  look  as  follows 


'0  0  0‘ 

’-0.25  -  0.25  —  0.25" 

A  = 

0  4  0 
0  0  0 

B  = 

-  0.25  2  -  0.25 

-0.25  -  0.25  -  0.25 

The  B  template  resembles  more  the  Laplacian  operation  commonly  performed  in  digital  image  pro¬ 
cessing  operations[7].  A  large  value  in  the  A  template  reinforces  only  the  output  pixel  value.  A  posi¬ 
tive  I  bias  leaves  the  areas  outside  the  detected  contour  in  a  dark  color.  The  result  of  applying  these 
templates  is  displayed  in  Fig.  13b.  Notice  that  the  contour  is  perfectly  detected.  The  post  processor 
was  used  with  this  image  together  with  the  original  image.  The  program  used  is  as  follows 

(main  edge.gif  original.gif 
(xx->red,  -edge.gif->red) 

(xx->red,  xx->red  &&  original .gif->red) 

(xx->green,  original.gif->green) 

(xx->blue,  edge. gif ->blue  A  original .gif->blue) 

(output  (out,xx))) 


The  files  edge .  gi  f  and  original  .gif  contain  the  processed  and  original  images,  respective¬ 
ly.  The  post  processing  objective  is  to  delete  the  red  color  from  the  white  areas  of  Fig.  13b  and  to 
highlight  them  in  a  color-coded  fashion  as  these  are  the  areas  that  contain  the  blood  vessels.  The 
blood  vessels  will  be  highlighted  using  green  and  blue  tones.  To  do  this,  the  red  color  layer  is  in¬ 
verted  to  delete  the  color  from  the  edge  detected  white  area  and  the  green  and  blue  layers  are  pro¬ 
cessed  with  the  original  image.  The  result  of  this  operation  is  shown  in  Fig.  13c. 

7.  CONCLUSION 

A  Cellular  Neural  Network  environment  for  color  image  processing  was  presented  in  this  paper.  The 
work  hereby  introduced  advanced  the  state  of  the  art  into  processing  of  color  images.  It  was  demon- 
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strated  that  by  collecting  results  from  the  cell’s  state  rather  than  from  its  soft  limited  output,  it  is 
possible  to  obtain  a  full  gamut  of  color  tones.  It  was  observed  that  this  mapping  of  cell  states  to  color 
values  is  not  straightforward  because  the  states  are  not  bounded.  To  overcome  this  limitation  two 
color  mapping  schemes  were  introduced  that  effectively  assign  states  to  distinct  color  hues.  The  er¬ 
ror  produced  by  these  schemes  is  minimum.  Therefore  they  are  deemed  to  be  very  suitable  for  CNN 
color  simulations. 

Finally,  from  the  examples  presented  in  the  last  section,  one  can  see  the  unquestionable  potential  of 
CNN  in  image  processing  applications. 
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Algorithm:  ( Multi-Layer  Raster  CNN  simulation) 

Obtain  the  input  image,  initial  conditions  and  templates  from  user; 

/*  M.N  ■  #  of  rows/columns  of  the  image*/ 
while  (converged_cells  <  total  #  of  cells)  { 
for  (layer=0;  layer  <  3;  layer++)  { 
for  0=1;  i<=M;  i++) 
for(j=l;  j<=N;j++)  { 

if  (convergence_flag  [1  ay  er]  [i]  [j] ) 

continue;  /*  current  cell  already  converged  */ 

/*  calculation  of  the  next  state*/ 

r‘»*i 

xlayerJpH+0  38  xftn)  +  /WO)  dt 

/(i 

/*  convergence  criteria  */ 

« ( -  0  and  yival  -  ±  1,  V  C^k, l)  e  AMU) )  ( 
convergence_flag  [i] [j]  =  1; 
converged_cells++ ; 

} 

}  /*  end  for  */ 

/*  update  the  state  values  of  me  whole  image*/ 
for  0=1;  i<=M;  i++) 
for  (j=l;  j<=N;  j++)  { 

if  (convergence_flagtlayer][i][j])  continue; 

xlay*rjft*)  xlayerjflfn+0  * 

} 

#_of_iteration++; 

} 

}  /*  end  while  */ _  _ 
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1:  main_file 

:  •  = 

* ( *  MAZE  (files) +  (process )+  (output) +  *)* 

2:  files 

: :  = 

NAME  . 

3 :  process 

: :  = 

'(*  (process_descr)  *)' 

4:  process_descr 

r 

(var)  •-•">•  (layer)  (var)  •-•*>•  (layer) 

(operand)  (var)  *-*•>»  layer  . 

(var)  •-••>•  (layer)  (var)  •-••>•  (layer)  . 

(var)  (layer)  *,*  (var)  (layer) 

(operand)  NUMBER. 

i 

(var)  •-••>•  (layer)  NUMBER  (operand)  (var) 

*-*  ">"  (layer) . 

i 

(var)  *-*•>»  (layer)  (negation)  (var) 

(layer)  . 

5:  var 

: :  = 

NAME  . 

6:  operand 

:  :  = 

(AMD  1  '&&*)  . 

(OK  'll")  . 

(XOR  '*')  . 

(SL  I  '«')  . 

(SR  I  •»•)  . 

7:  negation  ;:=  MOT  . 

8 :  layer  : :  =  RKD  . 

OREZM 

BLUE 

9:  output  ::=  '('  OUTPUT  '('  (files)  '  (var)  *)"  ')'  . 
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